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Abstract — In this article we introduce a broad family of adap- 
tive, linear time-frequency representations termed superposition 
frames, and show that they admit desirable fast overlap-add 
reconstruction properties akin to standard short-time Fourier 
techniques. This approach stands in contrast to many adaptive 
time-frequency representations in the existing literature, which, 
while more flexible than standard fixed-resolution approaches, 
typically fail to provide for efficient reconstruction and often 
lack the regular structure necessary for precise frame-theoretic 
analysis. Our main technical contributions come through the 
development of properties which ensure that our superposition 
construction provides for a numerically stable, invertible signal 
representation. Our primary algorithmic contributions come via 
the introduction and discussion of specific signal adaptation 
criteria in deterministic and stochastic settings, based respectively 
on time-frequency concentration and nonstationarity detection. 
We conclude with a short speech enhancement example that 
serves to highlight potential applications of our approach. 

Index Terms — Adaptive short-time Fourier analysis, frame the- 
ory, Gabor frames, overlap-add synthesis, speech enhancement. 

I. Introduction 

OVERCOMPLETE short-time Fourier methods are fre- 
quently used to analyze the time-varying spectral content 
of discrete-time waveforms x[t] arising in a variety of signal 
processing applications. Since the choice of localizing window 
function effectively controls the balance between time and 
frequency resolution a priori, standard representations cannot 
modulate this trade-off to adapt to the local spectral content 
of x[t]. Over the past two decades, this shortcoming has 
motivated the development of various linear and nonlinear 
adaptive time-frequency analysis methods [2]-[14], in applica- 
tions ranging from biomedical engineering [15] to radar signal 
analysis [16] and speech processing [17]. 

Despite the recognized importance of overcomplete signal- 
adaptive time-frequency analysis, the above methods generally 
fail to admit fast reconstruction of the signal x[t] from its 
time-frequency representation, by which we mean any non- 
iterative method that avoids direct (pseudo-)inversion of the 
corresponding analysis operator While approaches such as 
modulated lapped transforms for audio coding [18], wavelet 
packet decompositions via best basis [19], [20] and adaptive 
segmentation via dynamic programming [21]-[25] can lead to 
flexible tilings of the time-frequency plane, the general goal 
of efficient reconstruction from signal-adaptive, overcomplete 
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time-frequency representations remains an open problem. This 
issue is particularly important, given the recent interest in 
oversampled, modulated filter banks [26]-[28]. 

In this article we introduce a broad family of adaptive, linear 
time-frequency representations that admit a fast overlap-add 
reconstruction property akin to standard short-time Fourier 
techniques. We do so by adapting a given discrete Gabor frame 
to an observed signal x[t\ via superpositions of neighboring 
translates of a single window function, to yield the superpo- 
sition frames of the article title. Related procedures include 
the multi- window constructions of [29], in which multiple 
systems are defined on the same time-frequency lattice; and 
the multi-Gabor expansions of [30], in which multiple time 
lattices and windows are employed. However, neither of these 
schemes treats the use of subset selection to achieve a signal- 
adaptive system in the manner of the present article. More 
recent approaches [9]-[12] address subset selection from a 
Gabor frame or union of Gabor frames, but do not consider 
the structure of the corresponding canonical dual. 

A very recent approach in this direction is the study of 
general nonstationary Gabor frames [31], and indeed our 
contribution can be viewed as one possible instantiation of 
this framework. However, as we show below, the additional 
structure induced by our superposition construction yields 
several important properties, including, among other results, 
a preservation of the lower frame bound of the original Gabor 
frame, a generalized constant overlap-add property that avoids 
the explicit computation of dual windows, and a means of 
generating new families of adaptive lapped frames. 

The article is organized as follows. We begin by reviewing 
the short-time Fourier transform and Gabor systems on 
in Section [ll] Next, we introduce superposition windows in 
Section [nil and them to construct superposition systems in 
Section |lV| In Section [V] we prove that the resultant systems 
are in fact frames for C and study their frame-theoretic prop- 
erties, and in Section|Vl]we establish fast reconstruction via an 
analysis of the corresponding frame operator In Section [VTll 
we give examples of signal-dependent adaptation algorithms 
and illustrate their application to superposition systems. We 
conclude with a brief discussion in Section IVIIII 

II. Preliminaries 

We first review some well-known properties of Gabor 
frames [28], [32], [33] and discuss their relationship to short- 
time Fourier analysis. We take as our setting the space C^, 
and interpret its members as discrete-time i-periodic signals 
X G P{'Ll), with denoting the integers Z modulo L. 
The short-time Fourier transform (STFT) on uses a well- 
concentrated window function in order to localize x in time 
prior to the analysis of its frequency content. 
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Definition 1 (Short-Time Fourier Transform): Fix a win- 
dow w G and time-frequency lattice constants a, 6 > that 
divide L, with a an integer, and define M, N : Na — Mb ~ L. 
Then for the mth frequency bin index and nth window shift, 
with m € Zjvf and n € Z^r, the Gabor or subsampled short- 
time Fourier transform X[m, n] of a; G is given by 



X\m, n] 



L-l 

A \ " 



t=0 



x[t]w[t - na]e2'^™''*/i, 



(1) 



where i — y — 1 and ~ denotes complex conjugation. The 
expression of ([T]) can be viewed as a set of inner products of 
X with NAI time-frequency shifts of the chosen window w. To 
realize this correspondence, and to set notation, we introduce 
explicit translation and modulation operators as follows. 

Definition 2 (Translation and Modulation Operators): Let 
the translation and modulation operators T and A4 be defined 
as maps from to itself acting according to: 



27vimbt / L 



%iaw[t] = w[t - na], Mjnbw[t] = w[t] e 



Through the action of these operators, time-frequency shifts 
of the chosen window it; G may be indexed as 



= Mmb%iaw[t\, m e Zm, « e Z 



(2) 



and one speaks of a Gabor system '^^{w, a, b) — {(j)m,n}- In 
order to ensure a reconstruction property for any x from its 
subsampled short-time Fourier transform X[m,n], the Gabor 
system '^{w,a,b) must form a. frame for as follows. 

Definition 3 (Gabor Systems and Frames): A denumerable 
set {(pm.n} of vectors comprising time-frequency shifts of a 
single window function w G is called a Gabor system, and 
is said to be a Gabor frame for if there exist constants 
< A < B < oo termed frame bounds such that: 



<B\\x\\\ (3) 



with inner product (x, (j)m,n) = Ylf=o 3^M0m,"M = ^[m, n]. 

An upper frame bound B for ^ is guaranteed whenever 
the set {<j>m,n} is finite, and so the existence of a lower 
frame bound A > 0, for a finite Gabor system 'i^{w,a,b), 
is equivalent to the requirement that its elements span C^. 
This occurs ;/ and only if the frame operator is of full rank. 

Definition 4 (Gabor Frame Operator): Let '^{w,a,b) — 
{</'m,n} be a Gabor system on C'^, and define the frame 
operator S : through its action on x as 5a; = 



Then S is represented by the L x L 



symmetric and positive semi-definite matrix with entries 



M-l N-1 



(4) 



m— n— 



Remark 1 ( Strict Positive-Definiteness of Frame Operator): 
By Definition |4] the frame condition of (|3j is equivalent 
to strict positive definiteness of S and hence a necessary 
condition is that MN > L (i.e., ab < L). Moreover, the 
minimal and maximal eigenvalues of S yield optimal frame 
bounds, since ^ may be expressed as the requirement that 
A{x,x) < {Sx,x) < B{x,x), Vx G C^. 



The frame condition of (|3j in turn implies the following 
reconstruction property: 



A/-1 N-1 

Vx G C-^, t G Zz,, x[t] = Y X! <^m,")?™,"W' 

m— n— 

where the elements {0m, „} comprise a (not necessarily 
unique) dual frame. However, to each frame may be associated 
a unique canonical dual, whose elements are given by the 
action of the frame operator inverse S^^ on each </>,„,„. 
Moreover, in the Gabor setting, this canonical dual takes the 
form of another Gabor system 'i^{w, a, b), with w = S^^w. 

Any S can be written as a sum of outer products of each 
frame vector with itself; from (Hh via the orthogonality relation 



m— 



^2iTimb{t-t')/L _ 



when M divides t — t', 
otherwise. 



we obtain the so-called Walnut representation [34] of a Gabor 
frame operator S, which will be used repeatedly throughout. 

Definition 5 (Discrete Walnut Representation): Denote by 
M\{t - t') the condition that M divides t - t' , and by 
^M\{t-t')[t ^ i'] the corresponding indicator function on Z^. 
Then the frame operator 5 of a finite Gabor system {^(w, a, b) 
has banded structure, and satisfies the entrywise relation 



S[t,t'] 



t-t')[t~t'] 



N-l 
n=0 



![t]%,aW[t']. (5) 



Remark 2 (Covering Condition): Note that if 'i^(w,a,b) is 
a frame for C^, then (|5]l implies that the covering condition 



w[t- 



> oyt G Zl 



(6) 



must be satisfied, since a necessary condition for positive 
definiteness of S is that its diagonal entries are positive. 

Remark 3 (Window Length as Distinct from Support): The 
support of w G refers to the set of indices t for which 
w[t] ^ 0, with I supp(i(j)| its cardinality. Bearing in mind the 
summands of (|5]l and (|6]), define the length of w by 



len(w) = I supp(u') 



(7) 



if supp('U)) is contiguous, as is often the case in practice, and 
min„gZi(maxt,t/gZi \t-t' +l\:Tn{w[t]w[t']) ^ 0) otherwise. 

Remark 4 (Diagonal Frame Operator): It follows from (|5]) 
and ( [7|) that S is diagonal if M > len{w), since 
Tnaw[t]Tnaw[t'] = for all \t - t'\ > len(w), including 
those for which M divides t — t'. In turn, this implies 
efficient computation of the dual frame {Airnb%iaw}, with 
w — S~^w obtained via element- wise division of by 
S[t,t] = ^lEn=o \^\-^ ~ "-o-lP- In this case the condition 
of (|6]l is sufficient to guarantee the frame condition of (|3]l. 

We conclude by using the arguments of Remarks [3] and |4] 
to establish a result required for our subsequent development. 

Lemma 1: Fix any w G and a, b such that '^{w, a, b) is 
a frame for C^, with M — L/b. Then for any integral M' > 
len(w), the Gabor system 'i^{w,a, L/M') is also a frame for 



REVISED MANUSCRIPT 



3 



X^<XXXXXX 



>fyxxxxx 



(a) Superposition windows Wr, for r 
0, 1, 2, 4 merges of neigliboring translates. 



Fixed-Resolution Analysis Windows 




1a 2a 3a 4a 5a Ga 7a 
Adaptive-Resolution Analysis Windows 




(b) Translates of windows from a Gabor sys- 
tem (top) and superposition system (bottom). 



Fixed Lattice 



Adaptive Lattice 



Time 



(c) Corresponding time-frequency lattices associ- 
ated with the systems of Fig. |l(b)| 



Fig. 1. An example realization of a superposition system realized via two and then three window merges. 



Main Lobe Width (-3dB) 







w (Hamming) 

Rectangular , 




■ 1 ■ ■ ■ 





4 6 8 10 12 

Relative Sideiobe Attenuation (dB) 



6 8 10 

Spectrai Leakage (%) 




Fig. 2. Frequency characteristics of superposition windows Wr derived from 
Hamming windows, with a = len(too)/4 (e.g., 75% overlap), shown relative 
to those of rectangular windows of length len(tOr). 



C^, with diagonal frame operator and maximal lower frame 
bound given by (Af'/M) miuteZi, S[t, t]. 

Proof: We must show that if the frame operator S of 
a Gabor system ^^(w, a, b) on is full rank, then so is 
the frame operator S' of any system a, L/M'). For any 
M' > lcn(w), the argument of Remark |4] implies that S' is 
diagonal, with eigenvalues S'[t,t] — M' Y^^^^ \w[t — na]p; 
the Walnut representation of (|5]l further implies that S"[t,i] = 
{M' /M)S[t,t], for M = L/b. As <^{w,a,b) is a frame for 
C-^, it follows that S[t,t\ > 0. Hence S'[t,t] > for all 
t gZl, and thus S' is of full rank. ■ 

III. Superposition Windows 

Having outlined the connections between Gabor systems 
and the short-time Fourier transform, we now introduce 
the central ingredient of our signal-adaptive time-frequency 
analysis framework — the superposition window construction. 



illustrated in Figure 1(a) 



Definition 6 (Superposition Window): Fix a real, nonnega- 
tive window w on and an integer a — L/N, along with 
some r G Zjv. We then define the superposition window Wr to 



be a linear sum of r + 1 adjacent translates of w[t] as follows: 

r 

Vr[t]=J2'^naW[t], rel^N- (8) 



Wr 



ri=0 



Remark 5 (Fourier Transform Support): Let w denote the 
(discrete) Fourier transform of w G C^. Linearity of ([8]) 
implies that the support of uv is contained within that of w, 
as supp(w^) = supp(^^^Q e^^^™''('-'/^{y) C supp({y). 

Remark 6 (Fourier Transform Decay): As r increases, it is 
clear that can become more like a rectangular window 
(see, e.g.. Fig. 1(a) i; this effect is illustrated in Fig. [2] for the 
case of Hamming superposition windows. Consequently, the 
main lobe width of shrinks, leading to improved frequency 
resolution relative to wq; this main lobe resolution, however, 
comes at the expense of decreasing sideiobe attenuation. 
Spectral leakage — a function of the window smoothness — 
remains superior, as does overall spectral decay for small r. 

Our subsequent construction of superposition frames em- 
ploys sets of modulated superposition windows, and to this 
end we establish the following two energy "conservation" 
properties, proved in the appendix. 

Lemma 2 (Localized Parseval Property): Fix any w G 
and an integer M — L/b> len(u'). Then 



Vx G 



A/-1 

E 

m=0 



L-1 

\{x,Mmbw)\^ ^ MY,\x[mw[t\\\ 



(9) 



and 

rnL 



Lemma 3 (Superadditivity of Superposition Energy): 
Let real, nonnegative superposition windows Wp 
Wq be derived from a Gabor system '^{w,a,b) on 
and merge them to obtain a new superposition window 
Wp + Wq = Wp + T(^p+i)aWq- Then, if and only if 
M — L/b > len{wp + Wq), the following holds for every 
Mq = L/bo G {max(len(t(;p), len(i«g)), . . . , M}: 

Mo -I 

^ \{x,MmboWp)\^ + \{x,MmboWq')\ 
m=0 

< Y,\i^'-^rnb{Wp + Wq'))f , VxEl 



(10) 



m=0 



This superadditivity property, which is invariant to trans- 
lation of Wp + Wq', will be used in Section |v] to show that 
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adapting a Gabor frame through the superposition construction 
preserves the original Gabor lower frame bound — an important 
consideration for numerical stability. 

IV. Construction of Superposition Systems 

We now describe how to employ the superposition windows 
of Section [Hi] above to create a signal-adaptive analysis 
framework. Let a, h) represent a Gabor system, which 
induces a short-time Fourier transform on according to 
Definition [T| Beginning with 'S{w,a,b), we then form a 
signal-dependent, variable-resolution STFT by using the super- 
position sum of ([8]) to adaptively merge neighboring translates 
from the set {TnaW. n G Zat}. Later we will demonstrate how 
this signal-adaptive analysis can be coupled with a variety 
of different algorithms; we begin, however, by studying the 
general set of superposition systems independently of any 
algorithmic construction. To this end, we introduce the notion 
of ordered partition functions as a means of indexing arbitrary 
sets of superposition windows, and then extend these to yield 
a full time-frequency analysis. 

A. Ordered Partition Functions 

Observe that exactly 2^^^ distinct sets of variable-length 
superposition windows may be derived by merging window 
translates from a given Gabor system ^^(w, a, •). As a means 
of indexing these sets, the following "stick-breaking" analogy 
is helpful. Consider a "stick" composed of N ordered, unit- 
length pieces, representing elements of the set {T^aW^ n E 
Ztv}- Merging adjacent windows in this set can be thought of 
as fusing neighboring pieces of the stick. Each stick partition 
thus induces an ordered partition of the set {1, 2, ... . N}, with 
each piece uniquely identified by an initial index and length, 
and we may formalize this analogy as follows. 

Definition 7 (Ordered Partition Functions): We call any / : 
Zjv X Zjv — {0, 1} an ordered partition function if it is not 
identically zero, and satisfies the following three properties: 

1) Each piece of the stick is distinct: 

I[n, r] = l ^ I[n, /] ==0 Vr' ^r,r' E Zjy. 

2) The length of each piece is denoted by ?- + 1: 

I[n,r] = 1 ^ I[n',r'] = on {n+1, . . . ,n+r}xZN. 

3) All pieces of the stick are accounted for: 

/[ti, r] = 1 ^ I[n+r,r'] = 1 for exactly one r' E Z^. 

Definition [7] clearly implies that the "length" of the stick 
remains unchanged: 



J2 ^/Kr](r+l) = 7V; 



(11) 



moreover, each ordered partition function / can be associated 
with a set of translated superposition windows, which includes 
TnaWr whcncvcr /[n,r] = \. The following examples of 



Example 1 (N-Part Partition): The ordered partition func- 

is 



tion associated to the top panel of Fig. 1(b) 



1 if r = 0, 
otherwise. 



This clearly recovers the window translates of any Gabor 
system '^^{w, a, •). Note that in accordance with ( [TT| ), we have 
that EL^o Ef=V r]{r + l)^ ^t^o A^, 0] ^ N ^ 8. 

Example 2 ({N — 3)-Part Partition): The ordered partition 
function associated to the bottom panel of Fig. 1(b) is 



I[n,r] = 



/[2, 0] = I[6, 0] = /[7, 0] = 1 not merged. 



/[0,1] -/[3,2] = 1 



merged. 



Note again that in accordance with ([TTJ, we have that 

En J ErJo /[n, r] (r + 1) = 3 + 2 + 3 = 8. 



B. Superposition Systems 

We now employ the above construction to arrive at a 
variable-resolution time-frequency analysis via superposition 
windows. To this end, let the set ^ be defined as a function 
of any Gabor system '^^{w,a,b) on as follows: 



^ y ^{Wr,a,bL), 



where the frequency lattice b^Z encompasses all possible 
Gabor systems on for a fixed choice of integral M : 

6lZ; Ml = lcm({l, 2 . . . , max(L, A/)}), 6l = L/Ml- 

Elements of may then be defined in analogy to (|2]l as 

and in turn give rise to superposition systems, defined as 
appropriately chosen subsets of 

Definition 8 (Superposition Systems and Admissibility): 
Fix an ordered partition function /[n, and a 
function Af[n, r] : Zn x Zm^- We call any 

/[m,n,r] : Zm^ x Z^ x Z^ {0,1} an admissible 
selection function on ^ = Ur'^{wr, a,bL) if it satisfies the 
following two properties: 



I[0,n,r] = I[n,r] \/n,r eZn xZ 
/[0,n,r] = l ^ I[ 



N, 



Ml 



i,n,r] = 1, Vm E ZM[n,r]- (12) 



ordered partition functions are illustrated in Fig. 1(b) 



Furthermore, we call the induced set of elements a superpo- 
sition system ^{I). 

4'm,n,r € ^ {I) <^ /[m, n, r] = 1. 

It follows from ([12]) that the first M[n, r] modulates of each 
selected superposition window are included in ^(/), and thus 
we later suppress the dependence of / on frequency bin index 
m when possible, by abbreviating I[-,n,r] as I[n,r]. 
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V. Superposition Frames: Main Results 

Starting from a Gabor system ^^(w, a, b), we see that any 
superposition system =^(1) C Ur'^{wr,a,bL) effectively 
yields a "variable-resolution" subsampled short-time Fourier 
transform, defined for all m e and n,r eZn as 

X[m,n,r]4 /^'^''^'"'"■''^ if '^m,„,. e ^(/), ^^^^ 
I otherwise. 

Consequently, we now establish conditions under which su- 
perposition systems ^(/) form frames for C^, in analogy 
to the relation between a Gabor frame and its corresponding 
fixed-resolution short-time Fourier transform. 



A. General Case: Sufficiency 

To begin our analysis, consider the case of an admissible 
selection function I[m,n,r] for which M[n,r] = M„ for all 
n,r E Zn, corresponding to the notion of a global frequency 
lattice of arbitrary resolution: b„Z with feg = L/M„. Our 
first result, proved in the appendix, ensures that the induced 
superposition system ^{I) is a frame for if the following 
test condition holds. 

Theorem 1 ( Sufficiency Condition, Superposition Frames ): 
Fix a Gabor system ''^{w,a, ■) on C^, with N = L/a, w real 
and nonnegative, and define for s^tEZi^, n,reZjv, the term 

(3nr{s, t) = Wr[t ~ na]wr[t — na — s]. 

Let /[n,r] be any admissible selection function for which 
M[n, r] = Mg for some Afg e {1, 2, . . . , L}. Then, for index 
term k e {\{t~ {L- 1))/Afg] , . . . , [t/Mg\ }, the condition 



JV-l N-l 



eZl, ^/K'^](/3nr(0,t)-^/3„.(A:Mg,t)) >0 



n=0 r=0 



fc#0 



(14) 

is sufficient to guarantee that the superposition system ^(/) C 
U,4^(wr, a, 6l) is a frame for C^. 

Satisfying the criterion of ([14]) implies that the underlying 
frame operator is strictly diagonally dominant — a sufficient 
condition for strict positive definiteness. This is a popular 
criterion in the literature (see, e.g., [32, Corollary 6], [33, 
Theorem 8.4.4]) and, as can be seen from ( [l4| , takes a 
particularly simple form in the superposition setting. 

B. Superposition Frames and Frame Bounds 

In Theorem [T] above, we considered a general class of 
superposition frames associated with an arbitrary frequency 
lattice 6gZ. In Theorems |2] and [3] below, we study two distinct 
classes of superposition systems using non-uniform (local) and 
uniform (global) modulation structures defined as follows. 

Definition 9 (Admissible Selection Functions P and I^): 
Fix a Gabor system '^^{w, a, L/M), associate to it any ordered 
partition function /[n, r], and define 



Mr 



max (len(wr), M) : 



Mg = max Mr 

r : I[-,r] = 1 



br ^ L/Mr, (15) 

6g = L/Mg. (16) 



These quantities induce, via Af[?i,r] = -A#[-,r] = Mr or 
M[n, r] — Alg constant, respective classes of local and global 
admissible selection functions /' [m, n, r] and I^[m, n, r]. Note 
that when the admissible selection functions Iq or In-i occur, 
the constants of ( fTSj l and ([T6| are equal. 

We now show that superposition systems and 
are frames for C^. Later, we will verify that such frames admit 
diagonal frame operators. This special structure leads not only 
to fast reconstruction algorithms, but also to the preservation 
of lower frame bounds. 

Theorem 2 (Local and Global Superposition Frames): 
Let '^{w^ a, b) be a Gabor frame for C^, with w real and 
nonnegative. Then for any choice of admissible selection 
functions /' and /s, the local and global superposition 
systems J^(/') and ^(/^) are also frames for C'^. 

Proof: As our finite-dimensional setting implies the ex- 
istence of an upper frame bound for any admissible /, only 
the existence of a lower frame bound need be established. The 
proof proceeds via Lemma |3] and an iterative argument. 

To begin, consider the admissible selection function 
lQ[m, n, r] = /o[m, n, r] induced by an iV-part ordered parti- 
tion, which is associated to the event that no merging of win- 
dows in '^^{w,a,b) occurs, and hence ^{Iq) = '!^{w,a,bg), 
with bg = L/M„ and Mg = max(len(u'), Af) according 
to ([T6|. Lemma m then ensures that ^{Iq) = ■^{Iq) is 
a frame for C^, with maximal lower frame bound Mg — 

mintgzX^^Jo^ |7;iawWP > 0. 

Next consider any admissible selection function If[m, n, r] 
induced by an {N — l)-part ordered partition, corresponding 
to the case that exactly one pair of windows w = wq from the 
initial Gabor frame '^^{w, a, b) is merged via the superposition 
sum of ([8|. In this case, there exists one n* £ Zat such that 
/f[0,7i*, 1] = 1, and so ( [T2] l implies that =^(/f) contains the 
elements {Mmb„%i-'aWi : m E I'M,}- Each of these elements 
can in turn be decomposed into the following sum: 

MmKXi'aWl = M,nb,%i'aWo + ■Mmb„'^ri-+l)a«^0- (17) 

Since ( [T6] l implies Afg > lcn(wi) = len(wo + TaWo), we 
obtain by ^TJ) and the superadditivity property of Lemma [3] 



M„-l 



A/„-l 



\{x,Mrnbg%i'aWl)f > ^ \{x , Mrab,%i' aWo)\'^ 
m— m— 

Mg-1 

+ ^ |(x,A^„b_„r(„.+i),«;o)^ VxeC^. (18) 



Next, noting that by the decomposition of ( [T7] i, we have 

=^{w,a,bg)U{M,nb,Tn'aWl} 

\ {{Mmb^Tn^aWo} U {A^r«6g7(n* + l)a«^o}) , (19) 

we see that ( fTS] ! and ([T9| together imply that for all x G C^, 

J2 \{^^<P^,n,r)\^ > \{x.^m,n)\^. (20) 

Since ^^(u', a, bg) = ^{Iq) is a frame, the existence of a lower 
frame bound for J^(/f ) is guaranteed by ( pO] i. 
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Now consider the general case in which ^(J^) contains 
multiple merges. Since our construction ensures that all admis- 
sible selection functions can be obtained by iterative partition- 
ing in the manner above, we can always recover the inequality 
of ( |20] i for ^(/s) and any 6g according to ([T6|, by linearity 
of superposition and repeated application of Lemma [3] 

A similar iterative argument holds for with b„ 

replaced by bo from ( [T5] l. In place of ( [T9| ) we obtain 

= (^(u;, a, bo) U {M„^b^%^'aWl}) 

\ {{Mmbo%i'aWo} U {MmboT{n'+l)aWo}) , (21) 

with bi ^ L/Mi according to (15) . Note that 

Ml > len(?i;i) len(u'o + TaWo), 
Mo > len(wo), and Mi > Mo; 

thus, we may apply Lemma |3] to the latter three terms of ( |2T] l, 
yielding the required result for for all x E C^, 

tpe^ill) 4>e'^{w,a,bo) 

As above, the proof for general ^(/') then follows. ■ 
Thus we see that for every Gabor system on and any 
associated ordered partition function, setting M[n, r] in accor- 
dance with Mr or M„ will yield local or global superposition 
frames. Moreover, as we detail later, the iterative arguments 
employed above suggest precise algorithmic constructions. 

We now proceed to establish the important property that, for 
all local and global I[m,n,r] of Definition [9] superposition 
frames preserve lower frame bounds, thus ensuring numerical 
stability of the resultant representation. The following result 
also formulates the corresponding minimax-optimal superpo- 
sition frame bounds. 

Theorem 3 (Superposition Frame Bound Properties): Let 
^^(w, a, b) be a frame for C^, with associated maximal lower 
frame bound ^ > 0. Then for any admissible P and 1^: 

1) The quantity A remains a valid lower frame bound for 
both ^{P) and ^(/s). 

2) The minimum maximal lower superposition frame bound 
over all admissible /' and is 

Apt = ^ • (^11 \rnaw[t]\^^ , 

with fe™™ = min(6, L/ len(u))). It is attained in the 
absence of merging: ^(/') = ^(/s) = ^(u;, a, 6'"^'^). 

3) The maximum minimal upper superposition frame bound 
over all admissible /' and is 

L (\^^^ 2\ 

Bont = -, — — • max > %,„w\t\ , 

\ n=0 / 

with fe""" = min(6, 1). It is attained when all trans- 
lates of w have been merged: JF{P) = = 

^(zi'JV-l,i,6™"), with WN^l = EnJ'^naW[t]. 

Proof: Let S be the frame operator associated to 
'!^{w,a,b), with smallest eigenvalue A, and observe that 
miutezL S[t,t] > j4 by the Schur-Horn convexity theorem. 



Now, for any admissible or / , the proof of Theorem |2| 
shows that the maximal lower frame bound of ^(/^) or 
J^(/') is bounded from below by that of some ^^(w,a, 6'), 
with b' denoting respectively bg or bo- Therefore, [T]i will 
follow if we can show the maximal lower frame bound of 
'!^{w,a,b') to be no less than mintg^t ^[t, i]. To do so, note 
that Lemma[T|implies that the frame operator S' of ^{w, a, b') 
is diagonal, with smallest eigenvalue miufg^i, 5"[t, i] = 
(M'/Af ) minteZi S[t,t]; ([B) and ^ then yield M' > M. 

Next recall that superposition frames are induced from a 
Gabor frame ^^(w, a, b) by merging n G neighboring win- 
dow translates %iaW. By the above argument, minfgZL "^'i^ii] 
is itself a maximal lower frame bound for the case ^^(w, a, b') 
attained whenever no window translates are merged; likewise, 
the merging of all translates yields ^^(ti;7v_i, L, b") for some 
unique 6", with minimal upper frame bound maxfgzt S"[t, t\. 

To show that these cases are in fact extremal as claimed, 
we appeal to the same iterative argument used to prove 
Theorem |2] There, the superadditivity property of Lemma [3] 
was invoked to show that for any admissible or merging 
superposition windows cannot decrease the overall energy of 
the resultant frame coefficients. Thus, the case of ';^{w,a,b') 
considered above represents attainment of the minimum max- 
imal lower superposition frame bound, and moreover M' = 
max(M, lcn(w)) via ([TSj and ([T6|. Likewise, ^#(wjv-i, L, b") 
yields the maximum minimal upper superposition frame bound, 
with M" = max(M, len(w7v_i)). Lemma |2] then establishes 
the bound directly: 

X! \{x,(l)7n,n,r)f = Em=0^^ \ (x, M,nb"WN-l)\'^ 

0e??(io„_i,L,6") 

= A/"Efjo' MmwN^iit]]' < \\x\\^M''m&x\wN^i[t]\\ 

and the proof is completed by noting that as '!^{w,a,b) is 
assumed a Gabor frame for C^, the covering condition of 
Remark |2] implies that | supp(wAr_i)| = lcn(?i;Ar_i) — L, 
and hence M" = max(Af, L) as claimed. ■ 

VI. Fast Reconstruction via Superposition Frames 

We now show how the special structure of our superpo- 
sition construction gives rise to a number of efficient re- 
construction procedures. For any signal of interest x E C^, 
the superposition frame analysis coefficients X[m,n,r] = 
I [m, n, r] {x, (l)m, 71, r) can be computed via fast Fourier trans- 
form (FFT) once an admissible selection function has been 
specified. Superposition frames also enable fast (FFT-based) 
reconstruction from the corresponding analysis coefficients, in 
contrast to the general case of 0{L^) complexity for frame- 
based reconstruction via inversion of the frame operator 

We first provide a fast constant-overlap-add reconstruction 
method, which obviates the need for canonical dual frames. We 
next show that reconstruction via the canonical dual can also 
proceed by way of a pointwise modification of each superpo- 
sition window 4>o,n,r, followed by the application of FFTs, as 
in the case of general nonstationary Gabor frames [31]. Third, 
we show that in settings reminiscent of lapped orthogonal 
transforms, calculation of canonical dual windows is possible 
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independently of any — in contrast to the typical signal- 
adaptive setting, where the structure of the frame operator 
is a function of the instantiated signal adaptation. Last, we 
compare the computational complexity of these procedures. 

A. Reconstruction via the Constant Overlap-Add Method 

The classical "overlap-add" approach to signal reconstruc- 
tion from short-time Fourier coefficients proceeds as fol- 
lows [35]. Recall the covering condition of (|6]l which is 
necessary for a Gabor system ^^(w, a, h) to form a frame for 
C^, and also sufficient if M = L/h > len{w). Clearly, this 
covering condition holds if translates {%iaW : n S Za? } form 
a partition of unity on (see, e.g., the top panel of Fig. 1(b) i, 
and to this end we obtain the following definition, long popular 
in the signal processing literature. 

Definition 10 (Constant Overlap-Add Window Constraint): 
Fix a Gabor system {^(w, a, •) on C^. Then, noting the discrete 
Fourier transform evaluation w[0] = J2t=o ^W' '■^^ window 
w is said to satisfy the constant overlap-add constraint if 



n=0 



)[t — na] ~ 



}[0] 



(22) 



To clarify the role of this overlap-add constraint in fast 
reconstruction, consider a Gabor frame ^^(w, a, h) on for 
which w satisfies ( p2j i, with M = Ljh chosen such that 
M > len(w). The associated short-time analysis coefficients 
{X[m, n] : m e Zm, G Zat} are obtained as inner products 
of any x E according to ([T]i, and it is easy to show that 



N-l 



w[0] ^ 



M E 

, m— 



(23) 



The constraint thus admits a reconstruction procedure based 
on the overlapping additions of a sequence of discrete Fourier 
transforms on C*''^. 

Remark 7 ( Superposition Windows Preserve Overlap-Add): 
By their linear construction, superposition windows w,. 
preserve the constant overlap-add constraint of Definition [TO] 
for any Gabor system '^^{wr,a, •). To see this, note that the 
discrete Poisson summation formula on C^, for N = L / a, is 
given by J^^-^ h[t - na] - a'' ^fe^o e^"**^'^/^. Applying 
this expression to {%iaW : n £ Zjv} yields the relation 



JV-l 



,2TvitkN/L 



w[kN], 



k=0 



and it follows that the constraint of p2| ) holds (for a given 
time lattice constant a) if the Fourier transform w satisfies 

w[kN] = 0, Vfce {!,...,«- 1}. 

Since supp(uv) C supp({y), in accordance with the argument 
of Remarkjs] it follows that if ( |22] l holds for a given ^{w, a, •), 
then it will also hold for any 'i^{wr, a, •), for r E Z^. 

The popularity of the overlap-add constraint of Definition 10 
is due in large part to its simplicity, coupled with the efficiency 
of evaluating (|23]l. An important property of our superposition 



construction is that it preserves this constraint not only for Ga- 
bor frames '^^{wr, a,b), but also for all induced superposition 
frames ^(/s) and ^(P). 

Theorem 4 (Superposition Frames Preserve Overlap-Add): 
Consider a Gabor frame '^^{w,a,b) on satisfying the 
constant overlap-add constraint of ( |22] i. The following 
statements hold for any I^, and also for any with AIg,b„ 
replaced by Mr, br- 

1) The superposition frame satisfies the following 

generalized overlap-add constraint: 



N-l N-1 
n=0 r=Q 



w[0] 



(24) 



2) Each J^(/^) satisfies the overlap-add reconstruction 
property that, for any a; G with corresponding frame 
coefficients {X[m,n,r]} defined by ( [T3] l, 



JV-lW-l 



1 



Af„-1 

I- ' n=0 r=0 \ ^ m=0 



(25) 

Proof: First consider lQ[n,r], the global selection func- 
tion associated to the event that no windows are merged. In this 
case, the generalized overlap-add constraint of ( |24| i is satisfied 
by hypothesis, since it follows directly from (|22]i that 



n=0 r=0 



N-1 

E 

n=0 



%iaW[t] 



w[0] 



Now consider the global selection function /j[n, r], corre- 
sponding to the case that exactly one pair of windows w = Wq 
is merged. In this case, there exists some n* S Z^r such that 
/f[n*,l] = 1. Thus, the frame ^{if) contains the element 
{%i*aWi}, which can be decomposed according to (|8]l as 



%1'aWl = Tn'aWo + 7^„. +1)0^0. 



(26) 



Admissibility of if impHes that /f[n*,l] = 1, but that 
/f[n*,0] = /f[n* + l,0] = 0. Therefore, by ^ we have 



Y E l![n,r]T^aWr[t] = %,,aWi[t] + ^ /f [n, 0]r„, [t] 



n=0 r=0 



AT-l 

'- E '^naWn[t] 

n=0 



and we see that (|24]i holds for .^{If). Naturally, the selection 
function may index many merged windows — not just one, 
as in the case of l\. However, repeated application of the above 
argument shows that satisfies ( |24] l for any 1^. 

To prove Statement |2] note first that M„ > lcn(0o,,i,r) for 
each (po.n.r G in accordance with ( fTS] ). Recalling that 

X[m,n,r\ = P['m,n,r]{x,<j>m_n,r) by ([T3|, we observe that 
the innermost summation of ( |25] l is recognizable as an inverse 
discrete Fourier transform on C^^°, with Mg = L/bg. For fixed 
n and t—na G Z^v/,, this term evaluates to I^[n, r]%iaWr[t]x[t]: 

Afg-l 

lil-E ^[ir'^'"''^]^'"™''^*/^ = lHn,r]%,aWr[t]x[t]. 
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Perfect reconstruction then follows from the generalized 
overlap-add constraint of (|24l), as 



N-l N-1 



J2 J2 I^{n,r]TnaWr[t]x[t] = 



m 



wlO] ^ ^ 

I- J n=0 r=0 



}[0] a 



x\t\ = x\t\. 



For the case of a local selection function / , note that 
the generalized overlap-add constraint of ( p4j l is still implied 
by ( |22l ), since the argument for the case of admissible 
holds independently of the modulation structure employed. 
Consequently, by substituting AIj.,br for M„,b„ and noting 
that Mr > len((/)o. n,r) by ([TSj for each 0o.„.r G ^(/'), we 
see that the result of ( |25] l also holds for all ■ 

B. Reconstruction via Canonical Dual Superposition Frames 

We next develop the reconstruction properties of our super- 
position families in a frame-theoretic context, noting that they 
qualify as "painless nonorthogonal expansions" [36], and that 
the development below also holds for more general nonstation- 
ary Gabor frames [31]. In analogy to Definition l4l we associate 
a superposition frame operator Sj : through its 

action on any x G as Sjx — '^^^^fn{x, (p 

Definition 11 (Superposition Frame Operator, Walnut Form): 
The discrete Walnut representations of superposition frame 
operators and Sji are respectively given by the L x L 
positive semi-definite matrices with entries 



N-1 



Sn[t,t'] ^M, 



'-'gJlMg\(t- 



n,r— 



N-1 

Sil[t,t'] = J2 I^[n,r]MrlMMt-t'}[t-t']'^naWr[t]TnaWrW]. 
n,r— 

Theorem [5] implies that any Gabor frame ^#(u', a, b) and 
admissible 1^ or /' together give rise to a superposition frame, 
and hence the corresponding superposition frame operators are 
of full rank. Thus, to each global superposition frame ^{I^) = 
{4>m,n,r} corrcsponds a unique canonical dual frame {<pm,n.r}, 
whose elements are obtained in turn as (j)m,n,r — SYi^(f>m.n,r- 
Accordingly, when Sis is diagonal we may index elements 
of {4'm,n.r} by the Same admissible 7^, and we obtain the 
following reconstruction property: 

Vx e C^,t e Zl, x[t]= ^ {x,(pm,n,r)<fni,nA't]^ 
m.n^r:!^ [m,n,r] — l 

with the above also holding for local /' by Theorem |2] 
We thus denote by ^(/s) or ^(/') the corresponding dual 
frames, and observe the following consequence of the Walnut 



representation of Definition 1 1 above. 



Theorem 5 (Fast Inversion via Canonical Dual): For any 
^(/s), .^{P) derived from a Gabor frame ^(w, a, b) on C^, 
the corresponding operators Sit and Sp are diagonal, and 
each canonical dual frame element takes the form 



At] 



(27) 



for ^(/^), and similarly for ^(/') with respect to each Air- 



Note that the corresponding formula for the nonstationary 
Gabor frames of [31] in the diagonal case is similar to (j27|. 
However, in the superposition frame setting, the constraints on 
the window structure not only preserve lower frame bounds 
and yield fast inversion via the constant overlap-add method, 
but also enable signal-independent evaluation of the canonical 
dual in certain cases, as we now show. 



C. Adaptive Lapped Superposition Frames 

Reconstruction via the canonical dual ^(/s) according 
to ( |27] i requires knowledge of the admissible selection function 
/=[n, r] corresponding to a given signal adaptation. This stands 
in contrast not only to the usual Gabor setting, wherein the 
form of the canonical dual frame can be obtained immediately, 
but also to the constant overlap-add approach described in 
Section [VI- A| which avoids computation of the canonical dual 
entirely. However, by coupling our superposition construc- 
tion with the following neighbor overlap condition, we are 
able to compute prior to adaptation — that is, without 

knowledge of which ordered partition function will be used in 
subsequent signal analysis. 

Definition 12 (Neighbor Overlap Condition): Let^^(w,a, •) 
be a Gabor system on C'^, with N = L/a. It is said to satisfy 
the neighbor overlap condition if, for all n, n' E Zn, 

supp {%,aw) n supp (Tn'aw) = if | n - n' | > 1 . (28) 

Any admissible selection function preserves the neighbor 
overlap property, leading to the following notion of lapped 
superposition frames, whose properties we develop below. 

Definition 13 (Adaptive Lapped Superposition Frames): 
Let '^^{w,a, •) be a Gabor frame on that simultaneously 
satisfies the overlap-add constraint of ( |22] i and the neighbor- 
overlap condition of ( |28| l. Then for any admissible 1^, we 
call ^(/^) an adaptive lapped superposition frame. 

Note that the overlap-add constraint of ( |22] i ensures a 
partition of unity by window translates, while the neighbor 
overlap condition of ( |28| ) is also required in the case of lapped 
orthogonal transforms (see, e.g., [7]). While our construction 
retains the flavor of time-varying lapped transforms [37], [38], 
we emphasize that the resultant frames can avoid the lack of 
translation invariance inherent in the orthogonal setting, while 
still ensuring fast reconstruction. 

We show below that if ^{1°) is a lapped superposition 
frame derived from a Gabor frame a, b), then its canon- 
ical dual frame elements may be pre-computed. This situation 
is illustrated in Fig. |3] where the support sets of a window 
w, its canonical dual w, and their immediate neighbors are 
partitioned into subsets labeled L, C, and R. Since ^(7^) 
must inherit the neighbor-overlap condition from a, b), 
it follows that whenever ^(/^) admits a diagonal frame 

operator, the corresponding canonical dual windows of 
are constant on the center set C, as shown in Fig. [3] Moreover, 
the highlighted dual superposition window is pointwise equal 
to w on the sets L and R (see bottom two panels of Fig. |3]l. 
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Fixed-Resolution Anaiysis 




L c 
Canonicai Duai 




L C R 

Adaptive-Resolution Analysis 





L C 

Canonical Dual 





Fig. 3. Translates {Tnaw} from a Gabor frame 'j^{'W, a, ■) constructed from 
triangular windows with 50% overlap (top panel), shown with translates of 
its canonical dual window w (second panel); remaining panels repeat this 
sequence for an induced supeiposition frame '^X^fl:. ^^^^ right 

sets L and R, the canonical dual windows of ^(/s) agree pointwise with 
those of ^^"({5, a, ■); on the center set C, that of is constant. 



(29) 



To formalize this intuition, define for each r the sets 

Lr = Snpp{Wr) n SUpp(T„(r+i)aWr), 
< Rr = SUpp(Wr) n SUpp(7(r^i')(jWr), 
Cr = SUpp(Wr) \ {Lr U Rr), 

and note that, for any global selection function /°, (f>.,n,r G 
^(js) and its dual 5'7gV-,n,r G -^(I^) are both supported 
exclusively on the set Tna{Lr U Cr U Rr). Then the following 
theorem, proved in the appendix, establishes our main result: 
the canonical dual frame of any ^(/^) can be computed 
independently of any ordered partition function, and, therefore, 
can be computed prior to observing any data. 

Theorem 6 (Canonical Duals of Adaptive Lapped Frames): 
Let ^(/s) arise from a Gabor frame ^^(zi;,a, •) for C'^ 

satisfying (|22]) and ( |28| ). Then every 4)m.n.r S can be 

constructed by modulations AimbL ™d translations Tna of 
lapped windows corresponding to each r as follows: 



a 
ffi[0] 

w[t-(r+l)a\ 



if t e Lr, 
if t e Cr, 
if t e Rr. 



Here the sets Lr, Cr, Rr are defined in ( [29| l, and we note that 
only the expression for Cr is to be employed when is 
comprised entirely of modulations of wn^i. 

We note that many popular Gabor systems '^{w,a, ■) sat- 
isfy the requirements of this theorem — including triangular, 
Hamming, and raised-cosine windows w at 50% overlap — 
thus enabling a variety of new adaptive, lapped superposition 
frame families that all admit fast reconstruction. 

D. Adaptive Dyadic Superposition Frames 

Here we construct a class of so-called dyadic superposition 
frames that admit offline canonical dual construction even 



when the overlap-add constraint of ( |22| l is not satisfied. We 
base this construction on the notion of dyadic ordered partition 
functions, which may be thought of as indexing binary trees. 

Definition 14 (Dyadic Admissible Selection Functions): 
Let the number of translates iV of w in '^{w, a, b) be a 
power of two, and define the set = {0, 1, . . . , log2 iV}. 
An ordered partition function I'^[n,r] is dyadic if it satisfies 
the conditions of Definition |7] and 

T''[n, r] = 1 only if r = 2'' - 1 for some h G J^. 

We denote by I'^m, n, r] a dyadic admissible selection func- 
tion induced by I'^[n, r] and a global frequency lattice constant 
6g = L/M^, with Mg defined according to ([T6|. 

Viewing the N translates of w in ^^(u;, a, h) as leaves of 
a binary tree of height logj N, a dyadic ordered partition 
function selects windows corresponding to some tree level h. 

Definition 15 (Dyadic Gabor and Superposition Frames): 
Fix an initial Gabor frame '^{w,a,h), such that N = L/a 
is a power of two, and let h E index height in a binary 
tree. Now restrict r G Z„ to the index set ^ = {2'* — 1}, 
and fix for each r G a time lattice constant a,. = a(r + 1), 
and a dyadic admissible selection function with associated 
global frequency lattice constant 6g. Then: 

1) We define dyadic superposition Gabor frame Gr{bg) for 
all r E and their union Gfjr{bg), as follows: 

Gf{bg) ^ <^(Wr, ar, 6g) C '^{Wr, a, bL), 

2) We call ,'^{1'^) CZGfjr{bg) a dyadic superposition frame. 
The fact that ^{I'') and every dyadic Gfi^bg) = ^(w^, Or, bg) 
are frames for follows from the assumption that '^^{w, a, b) 
is a frame, coupled with the result of Theorem |2] 

An example of this construction is illustrated in Fig. |4j The 
left panel shows Hamming windows w = wq at 50% overlap, 
along with the corresponding dyadically-indexed superposition 
windows wi and w^, and an example dyadic superposition 
frame ^(/'*) at bottom. The right panel shows canonical duals 
associated to each dyadic superposition Gabor frame Gf{-), 
for r g {0, 1, 3}, along with the corresponding canonical dual 

,'^{1'^) at bottom right. The fact that ^(/'^) contains elements 

from each of these individual dual Gabor frames Gr{-) is 
verified by the following theorem. 

Theorem 7 (Canonical Duals of Adaptive Dyadic Frames): 
Let a dyadic superposition frame C Gfjr{bg) arise 

from a Gabor frame '^^{w,a,b) for satisfying the 

neighbor-overlap condition of ( |28] l. Then its canonical dual 
^{I'^) can be computed by either path of the following 
commutative diagram, where Sjd is the frame operator 
associated to ^(/'*), and 5"^ is that associated to each dyadic 
Gabor frame G^: 



(30) 
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TABLE I 

Computational complexity orders 0{-) of various analysis and synthesis algorithms considered in the article 



Analysis Complexity 
Synthesis Method 
Synthesis Complexity 



No Adaptation 
iVA/(l + log2 M) 

Overlap-Add Canonical Dual Section 

NM log2 M NM{1 + log2 M) NgMg{lo 



VI-A 


Section 


§2 JWg) 


iVgMg(3 + 



Adaptation 



VI-B 



Section 



VI-C 



AfgAfg(l +Togp\^g) 



(a)GS 





1a 2a 3a 4a 5a 6a 7a 



la 2a 3a 4a Sa Ga 7a 



Fig. 4. Repeated superposition merges of Hamming windows, following the 
structure of a binary tree, are shown in panels (a-c), along with the canonical 
dual windows associated to each corresponding Gabor system (e-g). A dyadic 
superposition frame .^{I'^) can be formed from the selected unmodulated 
elements of (d), which in turn will admit the coiTesponding canonical dual 
windows shown in (h), computed according to \21\ . 



Observe that computing the ,'^{1'^) via direct inversion of 
its (diagonal) frame operator Sjd corresponds to the down- 
and-right path in (QOll, and hence requires knowledge^f 
However, Theorem M impUes that all elements in ^{I'^) can 
be pre-computed by instead following the right-and-down path. 
As in the case of lapped superposition frames in Section [VI-C| 
the neighbor overlap condition of (|28| plays a key role. 



E. Computational Complexity 

We now address the relative computational complexity of 
the various reconstruction methods presented above. Recall 
that these algorithms all yield a diagonal frame operator, 
implying that only 0{L) operations are required for its in- 
version, compared to 0{L^) in the worst case of a non- 
diagonal frame operator lacking any special structure. While 
in some circumstances this complexity can be reduced (see, 
e.g., [32]), such schemes remain super-linear in L, rendering 
them impractical for use in applications with i 3> 1. 

Recall that when no windows are merged, we recover 
a Gabor frame 'i^{w, a, b) containing NM elements, with 
Na — Mb — L. If the associated frame operator is diagonal, 
an FFT-based approach requires NM{1 + logj A/) complex 
multiplications to compute the short-time analysis coefficients 
X[m, n] from x G C^, with NM of these needed to obtain the 
N individual short-time segments {^ait'[i]2;[i]Isupp(T„aiu) Ml- 
When reconstruction proceeds via inversion of the frame 



operator, then NM log2 M operations are required to compute 
the necessary inverse FFTs, plus NM operations to multiply 
each resultant segment by the appropriate dual window. In 
the overlap-add setting, this window is the identity, and hence 
these latter MN operations are avoided. An in-depth discus- 
sion of the general (non-diagonal) case, including methods 
based on the Zak transform, is given in [32] and [39]. 

In the case that windows are merged, note that a global 
superposition frame ^(/°) derived from ^^(w, a, b) comprises 
M, 



L/bg > M modulations of A'g < windows; 



(31) 



n=0 r=0 



It follows that A'gA/g(log2 A/g + 1) complex multiplications 
are required to compute the analysis coefficients X[m,n,r] 
via Ng FFTs, followed by N„Mglog2 M„ operations required 
for the A"g inverse FFTs required for reconstruction. 

If ^(/s) arises from the special case described in Theo- 
rem then the elements of ^(/s) can be pre-computed, and 
only N„Mg extra operations are necessary for multiplication 
by the requisite canonical dual windows. In the general case, 
elements of ^(/s) must be computed directly via ( |27] i, as 
a function of the chosen selection function /°. Appealing 
to pTj i, we see that this computation can be accomplished 
using another 2NgAIg calculations, leading to a total of 
iVgA/g(3 + log2 Afg) complex multiplications. This analysis 
is also an upper bound for the worst-case complexity for any 
J^{P) having the same ordered partition function as ^(/^). 

The various analysis and synthesis complexities discussed 
above are summarized in Table |l] In practice, the complexity 
of the signal adaptation procedure must also be taken into ac- 
count. This complexity depends both on the method for search- 
ing among ordered partition functions I[n,r], and the cost 
function used to compare them. Since it is clearly infeasible 
to compare all 2^^^ ordered partition functions by exhaustive 
search, we next consider greedy and dynamic -programming- 
based approaches below. In both cases, the complexity of 
evaluating the associated cost functions increases with window 
length, and therefore it is advisable in practice to set an upper 
bound on the maximal number of window merges. 

VII. Signal Adaptation Algorithms and Examples 

Signal-adaptive modification of an initial Gabor frame 
^^(w, a, b) on via superposition can produce any one of the 
possible 2^^^ superposition frames whose properties we char- 
acterized in Sections|V]and[yil We now detail two instances of 
a broad class of signal adaptation algorithms, any of which can 
be used to select a superposition frame for subsequent signal 
analysis. We propose both greedy and dynamic programming 



approaches in Section VII-A and illustrate their performance 



with two brief examples in Section VII-B 
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A. Signal-Adaptive Superposition Frame Selection 

The first of the two Gabor frame adaptation algorithms we 
describe is a simple greedy approach that can be implemented 
by "growing" a given window forward in time through suc- 
cessive attempts to merge it with its subsequent neighboring 
translates [1]. Whenever a proposed merge fails, the procedure 
resets and repeats, halting when the end of the data stream is 
reached (or, equivalently in our cyclic setting, when the initial 
window is once again encountered). 

A decision whether or not to merge adjacent windows can be 
made based on any suitable cost function. As one example, we 
employ the time-frequency concentration measure appearing in 
the popular work of [3], [4] on adaptive optimal-kernel time- 
frequency representations. Specifically, consider a short-time 
segment x,i^r[t] = {%iaw[t]x[t%^ppi^r„^^)[t]}^ and define its 
time-frequency concentration in the manner of [l]-[4] 



(32) 



with Mr, br defined via ( [T5] l. This ratio of powers of norms of 
short-time Fourier coefficients is suggestive of an "empirical 
spectral kurtosis," and has also been used in minimum entropy 
deconvolution [40]; other choices are also possible [14]. 

As shown in [3], maximizing ( (32] i favors short-time seg- 
ments that concentrate local signal energy within the smallest 
regions of the time-frequency plane. Indeed, below we obtain 
similar results on an example akin to the one employed in [3]: 
the resultant superposition frames comprise shorter windows 
near time-localized transients, and longer windows near oscil- 
latory signal portions. The resulting procedure requires 0{N) 
iterations and is summarized in Algorithm [T] 

Algorithm 1 Adaptation via Greedy Selection [1] 

Initialization 

m Fix input data x G and a Gabor frame 5f (w, a, b) 

• Set (p, rip) — (0,0) and initialize /[n,r] to be the A''-part 
ordered partition function of Example [T] 

Greedy Selection: For n = 0, 1, . . . , A*" — 1, 

• Compute a merged window 

T„^aWp+l = Tn^aWp + TnaW 

and C{x„^,p+i), C{xnp,p) and C{xn,o) via l|32]) 

• If C{x„p,p+i) < max(C'(a;„p,p), C(a;„,o)), r^ect the proposed 
merge: set (p, rip) as {p, n+p+1), and leave I[n, r] unchanged 

• Otherwise accept the proposed merge: set {p, Up) as (p+ 1, Up) 
and update I[n, r] as 

I\np,p+ 1] = 1 (add: Tn^aWp+i), 

/[np,p] = /[n,0] = (remove: T^^aWp, T„aW) 

Output: Return the set of variable-length windows induced by I[n, r] 

The second algorithm we present is based on the dynamic 
programming approach to adaptive segmentation popular in 
the audio coding literature [21]-[25]. The basic idea is to fix 
an additive cost function J(-), and find an optimal ordered 
partition function /* [n, r] in the sense that it minimizes the 



sum of individual segment costs J{xn,r[i\)'- 

/* [n, ?■] ^ argmin I[n,r\J{xn^r[i\)- 

/[n,rl rr it 
L ' J n^r:l [n,rj — 1 

Many choices for J(-) are possible, including rate-distortion 
cost functions [22], sparsity-inducing measures [14], and the 
well-known entropy cost of [19], which we employ below. 

To formalize our approach, define J* as the minimum cost 
among ordered partition functions on {0, 1, . . . , no — 1}, and 
let = J{xn r[t\) represent the cost associated to covering 
the region {na, na + 1, . . . , (n + r)a]. The resulting dynamic 
program requires 0{N'^) iterations and is summarized in 
Algorithm |2] 

Algorithm 2 Adaptation via Dynamic Programming [21] 
Initialization 

• Fix input data x £ C^, a Gabor frame 1^{'w, a, b) and initialize 
the cost function Jg = 

• For each T„aW G {TnaW : n G Zn} calculate the support set 

&u = {t: Tnaw[t] > T„,a'w[t],n / n' G Zn} 

Dynamic Program 

• For n = Q,l,...,A'' — 1, compute sequentially the nth segmen- 
tal cost and associated boundary by 



J* — min (J* + Jn,r 

0<r<n 



6* = arg min (J* + J„^., 

0<r<n 



with Jn,r calculated using signal data supported on U^jr^i^A; 

• Compute the optimal selection function /*[n,r] using {6^ : 
n G Zjv} via the standard "backtracking" procedure [21] 

Output: Return the set of variable-length windows induced by /* [n, r] 



Note that to preserve cost additivity in the presence of 
overlapping, non-orthogonal windows. Algorithm |2] evaluates 
J{x,i^r[t]) on regions smaller than those covered by the corre- 
sponding windows, in a manner which recovers the approach 
of [22] in the block-Fourier case. 

Once a set of variable-length windows is obtained via any 
selection procedure returning an ordered partition function, a 
local or global modulation structure can be chosen via ( [T5| ) 
or ( [T&l , respectively, in order to obtain a signal-adaptive super- 
position frame. In practice, application-specific considerations 
are likely to play a role in superposition frame selection, and 
to this end we note that a variety of other algorithms and 
approaches are possible (see, e.g., [17], [41], [42]). 

B. Illustrative Examples 

To conclude our investigation of superposition frames, we 
now consider two illustrative examples that combine Algo- 
rithms [T| and [2] with the analysis and reconstruction procedures 
presented earlier These examples — a stylized synthetic wave- 
form akin to the example employed in [3] and a phonetically 
balanced speech utterance from the TIMIT corpus [43] — 
both exhibit varying time-frequency structure, which in turn 
motivates signal-adaptive analysis and reconstruction. 

Our first example signal x (Fig. [5] top left) comprises a local 
and global sinusoidal term, two impulses, and a bump function. 
We conducted a variety of experiments in which varying levels 
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Fig. 5. Adaptive analysis-synthesis of a noisy synthetic signal (10 dB SNR) via superposition frames. Top left: Adaptive segmentations of the noisy 
signal (white, with clean version superimposed in black); background rectangles highlight the temporal extent of selected superposition windows. Bottom left: 
Results of a noise suppression experiment using an oracle (resp. two-stage) Wiener tilter, averaged over 50 trials. Standard deviations range from 0.13-0.27 
dB (oracle) and from 0.03-0.06 dB (two-stage). Right: spectrograms formed from the oracle-denoised signals using 80 sample Manning windows with 50% 
overlap. 



of white Gaussian noise n were added to x, and Algorithms [T| 
andU were then appUed to y — x + nto obtain signal-adaptive 
frame analysis coefficients Y[m,n,r] on a global frequency 
lattice (A/g = 6000). Using these as well as fixed-resolution 
analyses for a range of window lengths, we then applied to 
y[77z,n,r] both an "oracle" Wiener suppression rule (local 
signal spectrum estimated by |X[m, n, r] p) and a two-stage 
Wiener suppression rule (by appropriately soft-thresholding 
|y[m, n, r] p), and obtained a time-domain reconstruction x 
via the corresponding canonical dual superposition frame. 

The remainder of Fig. [5] reports the results of a typical run 
at 10 dB signal-to-noise ratio (SNR), with the superposition 
system of Algorithm [T] derived from an initial Gabor system 
^^(w,a, •) comprising a 100-sample Hamming window w and 
time lattice constant a = 50, and that of Algorithm |2] based 
on a 65-sample Hamming window with a = 32. Although we 
have observed Algorithm|2]to be more noise-robust in practice, 
and to yield better performance with somewhat shorter initial 
windows, it may be seen that both algorithms yield broadly 
similar analyses with respect to dominant signal features at 
10 dB SNR. Moreover, over a range of noise levels and fixed- 
resolution analyses, we have observed improved SNR gains 
201og]^o(l!y ~ ^11/11^ ~ ^W) in both the oracle and two-stage 
cases, as shown in the bottom-left panels of Fig. |5] 

Reconstruction spectrograms 20 logj^p ^] I — ^based 

on the oracle denoising for visual clarity — are shown in the 



right-hand panel of Fig. |5] They indicate that, in comparison 
to an a priori well chosen fixed-resolution analysis using 800- 
sample Hamming windows with a = 400, the onsets and 
offsets of localized time-frequency features are better pre- 
served by superposition frames. Since the best fixed-resolution 
window length is not known a priori in practice, the adaptive 
approach remains attractive, despite the lessening SNR gains 
obtained in the simple two-stage denoising approach. These re- 
sults suggest the investigation of more sophisticated denoising 
schemes, also bearing in mind that in the case of nonstationary 
noise, the best adaptive analysis may well be SNR-dependent. 

We repeated the same battery of tests with our second ex- 
ample signal X (Fig. [6j bottom), a portion of the phonetically- 
balanced TIMIT speech waveform /train/drl/fsah0/sil244.wav 
corresponding to the phrase ". . . [eye]d and amazed." This 
utterance, chosen to illustrate time-varying spectral content 
typical of speech, contains two plosives ([eye]d, amazet/), 
two steady vowels (and, amazed), and a time-varying diph- 
thong (amazed). The exact phonetic TIMIT segmentation 
(sil244.phn) is shown between the two spectrogram panels 
of Fig. |6j which correspond respectively to reconstructions 
based on an a priori well chosen fixed-resolution (top, 30 ms) 
and adaptive-resolution (middle. Algorithm |2] starting from 
3 ms Hamming windows with a — 1.5 ms) oracle- Wiener 
denoising, respectively, at 10 dB SNR. The bottom panel of 
Fig. |6] illustrates the corresponding adaptive analysis, which 
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Adaptive Wiener Oracle Denoising: Algorithm 2 




0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 



Seconds 

Fig. 6. Adaptive analysis-synthesis of a noisy speecli signal (10 dB SNR). 
Bottom: adaptive segmentation via Algorithm |2] shown with spectrogram of 
adaptive oracle-Wiener-denoised version. Top: spectrogram of fixed-resolution 
(30-ms) denoised version, shown with orthographic and phonetic transcrip- 
tions; boxes highlight temporal smearing of plosives and vowel onsets. Both 
spectrograms were formed using 5 ms Manning windows with 50% overlap. 

is seen to agree well with major features of the given TIMIT 
segmentation; Algorithm [T] also yielded a similar analysis. 

Following the same experimental procedure as in the case of 
Fig.|5] we observed broadly similar results — though with lower 
overall SNR gains obtained for this less stylized example. 
Importantly, however, superposition windows are seen to better 
preserve vowel onsets and plosives; see in particular the boxed 
regions of the fixed-resolution spectrogram in the top panel of 
Fig. |6] corresponding to the two plosives and initial vowel- 
diphthong onsets in the word "amazed." 

In this manner we see that superposition frames, when 
coupled with appropriate waveform adaptation criteria, show 
strong potential for use in a variety of signal-adaptive analysis- 
synthesis settings. For signal enhancement applications, a 
natural next step would be to extend the approach of [17], 
in which adaptive segmentation is used to estimate the local 
signal spectrum for enhancement purposes, but reconstruction 
is done using a fixed-resolution time-frequency lattice. A 
variety of other multi-stage or iterative approaches suggest 
themselves, given the additional flexibility engendered by the 
overcomplete, signal-adaptive superposition frames presented 
in this article. 

VIII. Discussion 

In this article we have introduced a broad family of adap- 
tive, linear time-frequency representations termed superposi- 
tion frames, and showed that they admit a host of desirable 



properties, including fast overlap-add reconstruction akin to 
standard short-time Fourier techniques. Through a discussion 
of signal adaptation criteria and multiple examples, the re- 
sultant analysis-synthesis systems were seen to provide an 
effective and practical method for realizing signal-adaptive 
time-frequency analysis coupled with fast reconstruction. 

Relative to other adaptive time-frequency methods, a num- 
ber of open questions remain. First, while many aspects of our 
construction admit straightforward extension to other Hilbert 
spaces of interest such as ^^(Z) or L'^(M), the present article 
has not addressed window requirements to ensure the existence 
of upper superposition frame bounds in infinite-dimensional 
settings, or attempted to characterize the structure of canon- 
ical superposition duals in such cases. Second, establishing 
additional connections to lapped transform constructions, in 
particular the tight lapped frames recently proposed in [44], 
seem a promising avenue for further investigation. 



Appendix 

Proof of Lemma^ To establish Q for all w G and 
A4 > len(w), expand the left-hand side of (|9]l as 

M-l M-1 

\{x,MmbW)f = {x,MmbW){x,M„ibW) 

m— m— 

L-1 L-1 M-l 

= x[tmWMt'] E 

t=0 t' = m=0 
L-1 L-1 

= M E E ^M\{t-t')[t - t'] x[t]x[t']w[t]w[t']. (33) 

Now consider all M > lcn(ii;) that divide t — t'; since 
w[t]u'[t'] — for all \t — 1'\ > lcn(u'), we need only consider 
the case t — t' — 0, whereupon we recover from ( |33| l the 
right-hand side of (|9]l. ■ 
Proof of Lemma |5| To prove sufficiency, assume that 
A/q — M, and hence bo ~ b. From (|9]l of Lemmaj2] it follows 
that the right-hand side of ( [T0| maybe expandecTas 

L-1 

MY,\x[t]\' (\wp[t]\^ + + 2Re{^]wg ' [f] }) , (34) 

i=0 

with the rightmost term nonnegative by Definition [6] Dropping 
this term from (|34]) and applying (|9| again, this time in 
the reverse direction, shows that ([T0| holds for any Mq £ 
{max(len(wp), len(wq)), . . . ,M}, thus proving sufficiency. 

To prove necessity, assume to the contrary and consider a 
setting in which M < len{wp + Wq) — L. Noting that ( fTO] ) 
may be stated as {S^P''i^x,x) < (S'^'+'^a;, cc) for positive 
semi-definite frame operators S^^''^'' and S'(p+9), assume that 
elements of the former span and thus form a frame; hence 
(S'(P^'?)a;,x) > for all nonzero x e C . However, since 
M < L, the M elements of the latter cannot span C^. 
Hence there exists at least one nonzero x E such that 
(^S^P+i)x^x) = 0, thus contradicting the stated inequality. ■ 
Proof of Theorem [7| To establish the theorem we directly 
bound the quantity \{x,4>m,n,r)\'^ from below. To 
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begin, observe that 

A/„~l jV-1 

\{x,(f)m,n,r)\^ = ^ ^ I[n, r]\{x , Mmb^'TnaWr)\ 
JV-1 L-1 

= Mg^7[n,r]^ 2;M^T„„(^w;,[t'])lMg\{t-t') [t-i'], 

n,r=0 t,t'=0 

with the latter expression above obtained by the expansion 
of Now, if Afg divides t - t' , then t' = t - k{t)AL for 
some integer fc(t), whose domain is deduced by observing that 
<t - k{t)Mg < L - 1 and < < L - 1 together imply 
that k{t) e J(r = {\{t - {L - 1))/Afgl , . . . , [t/MoJ }. Then, 
a change of variable for t' yields the simplification 

L-l JV-1 

t=0 n,r=0 fc(t)gjr 

For fc = 0, this quantity can be bounded from below as 

> Mg\\x\\^ ■ mintgZi En,rio -^["-' '"1 \Tua'Wr[t]\^ , 

with the remaining terms in \ {0} handled as follows. 
Invoking the assumption of a real, nonnegative window w to 
simplify the corresponding expression, observe that the terms 
Tna{wr[t]'^r[t — kM^) are then everywhere nonnegative. The 
sum of the remaining terms can hence be bounded below by 



Mgmin ^ I[n,r] ^ {T,^a{wr[t]wr[t - kM^\)) 
^ n,r=0 fc{t)ejr\{o} 

L-l 

• ^ x[t"]x[t" - fcMg] 

t"=0 
JV-1 

> -Mg|la::f min ^ 7[n,r] ^ T„„(u;r[t]wr[t - fcMg]), 



n,r— 



fe(t)ejr\{o} 



where the second inequality follows by observing that 

Ef=o^[*+«]^ > -\\xf for any / e and s e Z^. Thus, 

we obtain the claimed results since I^^' 4>m.n.r)\'^ is 
bounded from below by il/g||a;|p times 



mm 



fc6jr\{o} 



^ n,r— 



Praq/o/77zeorem[6]- To establish the result, first note that 
5/g is by hypothesis diagonal, and hence by (p7)t, we have 



M 



mh 



TnaWr[t] 



(35) 



If all windows {%iaW : n e Zjv} have been merged to yield a 
single superposition window wn-i whose modulates comprise 
the superposition frame of interest, then the constant 

overlap-add constraint of (|22]) applied to ( |35| ) immediately 
implies the result, as both its numerator and denominator 
yield constants, whose ratio is in turn a / {Mgw[0]) , with 
Aig = max(L, M). Therefore, assume that this is not the case. 

To begin, note that ( |35] l, together with the neighbor-overlap 
condition of (|28|), implies that supp{(j)m,n,r) ^ '?^ia(ir U U 



Rr). Since these sets are mutually disjoint, we proceed by 
showing that p5| ) agrees with 



where 



o[t] if t £ TnaLr, 

1 a 2TTimbLt/ L \f + a T C 

Mg i2[0] ^ 11 t t J-na'^r, 

[t] if t G T„aRr, 



4'm,n,o\t] — 



(36) 



We now proceed to show th at ([35] l evaluates to ( (36l l. First, 
we have that the numerator of (|35|l evaluates on T^^r to 



where the second equality follows from the neighbor overlap 
condition of ( |28| ), and the third by the overlap-add constraint 
of ( |22] i to geth er with the definition of the set Cr- The denom- 
inator of ( |35| l evaluates on this same set %iaCr to 

= {AL\T„aWr[tf)lT^^cAt] = Ir^c.M, 

with the first equality following from the fact that no windows 
other than TnaWr are supported on TnaCr, and the second 
from ( |22| ). Hence we have equality of ( (35] l and ( [36) 1 on TnaCr- 
Applying next the neighbor-overlap condition of (|28| and 
the definition of Lr, we observe that the corresponding nu- 
merator term of ( [35] l evaluates to 

Mmbi^T„aWr[t] Ir„„L^[t] = Almbx, (En'=0 M ) It„„L,. [i] 



Evaluating the denominator of ( [35) on T^aLr yields 

(Ms En'll Er'Zl inn',r']\TM> [t] \^)It„.l. [t], which 
may be split into three parts according to index n, including 
the term TnaWr[t] as follows: 

The middle expression of iT^aWrliU^tems from the fact that 

/s[n,r] = 1 whenever (/)..„,r G •^{I^), and correspondingly 
r'] = whenever r' r, since is an admissible selec- 
tion function. Moreover, coupled with the assumed neighbor- 
overlap condition of ( |28] l, this same property implies that 
exactly two superposition windows are supported on TnaLr, 
one of which is the superposition window TnaWr[t\ isolated 
in the sum above. 

By the superposition construction, it must be the case 
that the portion of TnaWrlt] supported on TnaLr takes the 
form Tnawlt], whereas the portion of the remaining window 
supported on TnaLr takes the form T(^n-i)a'w[t\. Thus 

= A/g (|T(„_i)„«;M|2 + |T„„™MP) Ir„„L4t] (37) 
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and ( |35| l is seen to equal ( |36l ) on the set TnaLr- The case of 
TnaRr pi'oceeds by an identical argument, thereby confirm- 
ing that ( (35] l agrees separately on Tna{Lr,Cr, Rr) with the 
quantities of (|36]l, as claimed. 

Finally, to complete the proof, observe that the 
cyclic group setting of implies the relation 

[t] = M„ibL%ia4'Q.o,o[t]' since for any integer n, 

J2n'=o\'^n'aW[t]\^ = J2n'=0 \'^(n' +n)aW[t]\'^ ■ Applying this 

relation to ( |36l ), we obtain the theorem as stated. Note that 
for local the sequence of equalities analogous to those 
in ( (37| i requires knowledge of the local frequency lattice, 
which may not be known prior to observing the signal. 

■ 

Proof of Theorem [?]• The dyadic superposition frame 
^(J'*) represents the set of elements selected from Gy^(6g). 
Here we denote its the canonical dual by ^/d(Gy^), re- 
flecting the explicit dependence on Gy^, and likewise define 
=F/d(UG^), the set of elements selected by I'^ from UremGr- 
To establish the result, we must verify the claimed equality 



(38) 



We proceed to establish the equality of ( [38) elementwise, 
rioting first that the number of modulates of some T^aWr in 
^/d(Gy,^) is given by A/g = L/h^ and, by construction, is 
equal to the number of modulates of the same shifted window 
in each Gf.{bg) — '^^{wr,a,bg). We therefore fix m € 
and r E for the remainder of the proof. 

Since the dyadic superposition frame operator Sjd is diago- 
nal, the superposition Walnut^ formula of pT] ) implies that we 
may write each (pm^n.r & ■^i<'{Gfjr) as 



.At] 



Each element 



MrnbL%iaWr[t] 



M,En'=oEXonn',r']\%'awAt]\' 
t'm,n",r & G^ Can be likewise written as: 



4t] 



(39) 



(40) 



with Qr = a(r + 1), Nr = L/ur, and < n" < Nr, in 
accordance with Definition [15] Note that we ordinarily index 
modulations of Gabor frame elements by mbg,m £ Z^/^,, but 
in ( |40l ) we adopt the indexing scheme mbL for appropriate 
m £ Za/^, in order to facilitate its direct comparison to ([39|. 

In order to establish Jhe equality of sets in ( (38] l, we need to 
show that if (pm.n.r G --^idiG^r), then the expressions in ( |39l ) 
and ( |40] l are equivalent; i.e.. 

To establish the implication of ( |4T] i, we first show that the 
condition I'^[m,n,r] = 1 implies that the numerators of (|39]) 



and ( [40| i agree. Since m and r are fixed, this means that for all 
n such that /''[to, n, r] = 1, there must exist an < n" < 
satisfying 

MmbL%iaWr ^ MmbL%i"a,Wr- (42) 

Equality in ( |42j i is achieved when na — n"ar — n"{r + l)a, 
which clearly holds if r + 1 divides n. But since I'^[m, n, r] 



selects elements from G,^ = 'i^{wr,a{r + l),&g), then r + 1 
divides n by construction, and (|42| follows. 

The argument for agreement of the denominators is more 
delicate, because it is not true that for all t e Z^, 

(43) 

Instead, we show that ( |43| l holds for all t e supp {TnaWr) — 
which, together with ( |42] l, is sufficient to establish ( pT) , and 
consequently our claimed result. 

Let Sn^r — supp(7r„£iU'r), with Is^ ^[t] the corresponding 
indicator function. Using the same arguments as in the penul- 
timate portion of the proof of Theorem |6j observe that the 
left-hand side of ( |43| ) can be decomposed as follows; 



- ( E.^;o E::rio i>'. A\t^,^w,. m p + r^,^i{t\ 



Z^r'=0 Z^n'=ji+1 ' ' W-'n'a 



= {\T(^n-l)aW[t]\^ + \TnaWr[t]\^ + \T^n+r+l)aW[t]\^) h^Jt]. 

Applying the neighbor-overlap requirement of ( |28| ) to the 
right-hand side of ( |43| ) then yields 

— {\T{n-l)a'w[t]\'^ + l^iaWr[i]P + |'?(n+r+l)aW 

thus establishing the equality of (|43]l, and hence the result. ■ 
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